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V£7fcfljggS5ftent Name] SPECIFICATION 

[Title of the Invention] IMAGE ENCODER AND IMAGE DECODER 
[Claims ] 
[Claim 1] 

An image coding device comprising: 

a tile decomposition portion for decomposing image data 
into tiles each having N pixels x M pixels ; 

a wavelet coding portion for extrapolating a predetermined 
data at the periphery of the objective data from the tile 
decomposition portion, decomposing each of the tiles into 
subbands and separately wavelet -encoding each of the tiles; 

a management information generating portion for generating 
management information necessary for independently decoding 
coded data of the subbands from the wavelet coding portion on 
a tile-by-tile basis as well as on the subband-by-subband 
basis ; and 

a coded data integrating portion for combining the data 
separately wavelet -encoded on a tile-by- tile basis according 
to the management information outputted from the management 
information generating portion and attaching the management 
information to the coded data. 
[Claim 2] 

An image decoding device for receiving coded data coded 
and inputted by the image coding device of claim 1 and 
reproducing a desired image by selectively decoding the coded 
data of necessary tiles and subbands, comprising: 
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a management information separating portion for separating 
tile-and-subband management information from input coded 
data; 

a coded data extracting portion for selectively extracting 
coded data of required decodable objective tiles and subbands 
according to the management information; 

a wavelet decoding portion for performing wavelet decoding 
of the extracted coded data in compliance with the wavelet 
coding conducted by the image coding device of claim 1; and 

a tile combining portion for combining wavelet -decoded 
tile images into a desirable image. 
[Claim 3] 

An image coding device comprising: 

a tile decomposition portion for decomposing image data 
into tiles each of N pixels x M pixels and outputting the N 
pixels x M pixels in the tile as an objective data to be coded 
for a corresponding each of the tiles ; 

a peripheral pixel adding portion for providing an 
objective tile to be coded with adjacent pixels necessary for 
wavelet transformation of the objective tile to be coded when 
such pixels exist at the periphery thereof; 

a wavelet coding portion for extrapolating a predetermined 
data when no pixel existing at the periphery of the objective 
tile to be coded, decomposing each of the tiles into subbands 
and outputting only wavelet coefficients of the objective tile 
to be coded; 
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a management information generating portion for generating 
management information necessary for independently decoding 
coded data outputted from the wavelet coding portion on a 
tile-by- tile basis as well as on a subband-by-subband basis; 
and 

a coded data integrating portion for combining the data 
separately wavelet -encoded on a tile-by-tile basis according 
to the management information outputted from the management 
information generating portion and attaching the management 
information to the coded data. 
[Claim 4] 

An image coding device comprising: 

a wavelet coding portion for decomposing an image into 
subbands by extrapolating a predetermined data at the periphery 
of the image, and performing wavelet encoding of the subbands .- 

a tile composing portion for reconstructing, from wavelet 
coefficients inputted from the wavelet coding portion, 
separate tiles each being composed of N x M wavelet coefficients 
forming a (membership) set to be separately entropy coded; 

a management information generating portion for generating 
management information necessary for independently decoding 
coded data outputted from the wavelet coding portion on a 
tile-by- tile basis as well as on a subband-by-subband basis; 
and 

a coded data integrating portion for composing a sequence 
of the coded data according to the management information from 
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the management information generating portion and attaching 
the management information to the coded data. 
[Claim 5] 

An image decoding device for receiving coded data coded 
and inputted by the image coding device defined in any of claims 
3 to 4 and reproducing a desired image by decoding the coded 
data of necessary tiles and subbands , comprising: 

a management information separating portion for separating 
tile-and subband management information from the input coded 
data; 

a coded data extracting portion for extracting coded data 
part corresponding to an objective tile and subbands according 
to the management information; 

a wavelet decoding portion for performing wavelet decoding 
of the extracted coded data by the image coding device and 
obtaining the decoded image composed of on the tile-by-tile 
basis; and 

a tile integrating portion for arranging the wavelet - 
decoded image composed of on the tile-by- tile basis at 
respective places on an original image and superposing image 
values at overlaps of neighboring tables to integrate the tiles 
into a desired decoded image. 
[Claim 6] 

An image decoding device for receiving coded data coded 
and inputted by the image coding device defined in any of claims 
3 to 4 and reproducing a desired image by selectively decoding 
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the coded data of necessary tiles and subbands , comprising: 

a management information separating portion for separating 
tile -and subband management information from input coded data,- 

a coded data extracting portion for selectively extracting 
coded data of required decodable objective tiles and subbands 
according to the management information; 

a wavelet decoding portion for performing wavelet decoding 
of the extracted coded data by the image coding device , and 

a wavelet -coef f icient rearranging portion for rearranging 
the wavelet coefficients reconstructed on a tile-by-tile basis 
by the wavelet decoding portion into an initial order of them 
before having been tiled. 
[Claim 7] 

An image coding device as defined in any of claims 1 to 
3 , wherein the wavelet coding portion is provided with a memory 
necessary for storing at least data for the tile. 
[Claim 8] 

An image decoding device as defined in any of claims 2 to 
5, wherein the wavelet decoding portion includes a memory for 
storing data at least for the tile. 
[Detailed Description of the Invention Pertain] 
[0001] 

[Technical Field to which the Invention] 

The present invention generally relates to the field of 
digital image processing and, more specifically, to an image 
coding device for encoding digital image data with high 
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efficiency and an image decoding device for decoding coded data 
encoded by the image coding device. 
[0002] 
[Prior Art] 

Flash Pix format specification version 1 . 0 has been 
proposed as an image format for converting natural image data 
into digital data suitable for computer processing. 

This format specification permits a plurality of data with 
different resolutions to be stored together therein so that 
any data suited to an actual display and/or printing device 
can be selected and taken-out promptly in response to a user's 
request . Furthermore, each image is divided into tiles arranged 
in the format that allows the user to select only a necessary 
data portion of the image and process it in an enlarged or 
reduced size with a reduced processing load. 
[0003] 

Referring to Figures 13, an image coding device for 
encoding an image according to the flash pix format is described 
as follows. In Fig. 13(a) , images are shown in different reduced 
scales, each of which are divided into tiles. Figure 13(b) is 
a block diagram of an exemplary image coding device . 

The flash pix method is featured in that it generates first 
images 1 to 4 in sizes 1/1 to 1/8, as shown in Fig. 13(a), then 
divides each image into tiles and compresses data of each tile 
image . 
[0004] 
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First, a case of encoding an image 1 shown in Fig. 13(a) 
by the coding device of Fig. 13(b) is described. In Fig. 13(a) , 
a dashed line shows the boundary between tiles . 

A tile decomposition portion 1301 divides an original image 
into tiles each comprising 64 x 64 pixels, which tiles are then 
compressed one by one by a JPEG compressor portion 1302. In 
a coded-data integration portion 1303, coded data of each tile 
is combined with tile decomposition information from the tile 
decomposition portion 1301 to form coded data 1 to be output. 
[0005] 

The image 2 of Fig. 13(a) is described. The original image 
0 is reduced to 1/2 in length and width by a 1/2 contraction 
portion 1304, and then the 1/2-size image is processed through 
a tile decomposition portion 1305, a JPEG compressor portion 
1306 and a coded-data integration portion 1307 to form coded 
data 2. 

Size reduction of the image to generate a group of 
size-reduced images in Fig 13(a) (Images 2 to 4) is repeatedly 
performed until a downsized image containable within a single 
tile is obtained. For example, the image 3 is still larger than 
a tile and is further contracted by a factor of 2 to obtain 
the image 4 allowable within a single tile as shown in Fig. 
13(a). The size-reduction procedure is now finished. 
[0006] 

Coded data for the image 3 is produced through a 1/2 
contraction portion 1308, a tile decomposition 1309, a JPEG 
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compressor portion 1310 and a coded data integration portion 
1311. Coded data for the image 4 is produced through a 1/2 
contraction portion 1312, a tile decomposition portion 1313, 
a JPEG compressor portion 1314 and a coded data integration 
portion 1315. 
[0007] 

However, the above-described system involves the following 
problems: Storing coded data for images downsized with 
different resolutions in addition to coded data for the image 
with the scale 1:1 results in increasing a volume of coded data 
by a factor of 1.4. Furthermore, compression for encoding data 
must be done for each resolution image, resulting in 
considerably increasing processing load. 
[0008] 

On the other hand, apart from the Flash Pix method, the 
image compression can be also accomplished by the wavelet 
transform technique whereby image data with different 
resolutions can be easily decoded from coded and compressed 
data of an original-size image. This technique is therefore 
free from the problem with increasing the amount of coded data. 
Namely, the wavelet transform method can meet the demand for 
decoding data with different resolutions without any increase 
of coded data whereas the Flash Pix method has an increase by 
a factor of 1.4 in volume of coded data. 
[0009] 

Figure 14 is a basic block diagram of a wavelet transform 
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coding portion wherein an original image is converted by a 
wavelet transform portion 1401 into data for subband divisions, 
which data is quantized by a quantizing portion 1402 and then 
entropy encoded by an entropy coding portion 1403 to produce 
coded data. 
[0010] 

Figure 15 is a detailed block diagram of the wavelet 
transform portion 1401 of Fig. 14. Figure 16 depicts an example 
of the wavelet transformation of an image in case of conducting 
two-dimensional subband decomposition three times. 
[0011] 

An original image shown in Fig. 16(a) is filtered through 
a horizontal low-pass filter 1501 and a horizontal high-pass 
filter 1502 to create two horizontal subbands that are then 
decimated to 1/2 respectively by 1/2- subs ampling portions 1507 
and 1508 (Fig. 15). Two horizontally divided subbands are 
divided each into two subbands through vertical low-pass 
filters 1503, 1505 and vertical high-pass filter 1504, 1506, 
which subbands are decimated each to 1/2 by 1/2 sampling 
P or "tions 1509 to 1512. Consequently, four subbands are formed. 
A high-horizontal and high-vertical frequency subband " J " 
(Fig. 15), a high-horizontal and low-vertical frequency 
subband "'J" (Fig. 15) and a low-horizontal and high-vertical 
frequency subband "f" (Fig. 15) correspond to wavelet transform 
coefficients "f " , n| J" and "J" (Fig. 16(b)) respectively. After 
this, only a remaining low-horizontal and low-vertical 
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frequency subband 1513 is recursively divided into subbands . 

This recursive subband decomposing process is performed 
by horizontal low-pass filters 1514. 1526. horizontal 
high-pass filters 1515, 1527. vertical low-pass filters 1516. 
1518, 1528, 1530, vertical high-pass filters 1517, 1519, 1529. 
1531 and 1/2-sampling portions 1520-1525, 1532-1537. Sub- 
bands "<f"_"|»- (Fig. 15) correspond to sub-bands (Fig. 
16(b)) respectively. 
[0012] 

Wavelet transform coefficients shown in Fig. 16(b) are 
quantized on a subband-by- subband basis by a quantizing portion 

1402 (Fig. 14) and then entropy encoded by an entropy coding 
portion 1403 to produce coded data. The entropy-coding portion 

1403 may use Huffman coding or arithmetic coding. 
[0013] 

On the other hand, wavelet-coded data is decoded by an 
entropy decoding portion 1701 and inversely quantized by an 
inverse quantizing portion 1702 (Fig 17). Subbands are then 
combined by an inverse wavelet transform portion 17 03 to 
produce a decoded image. 
[0014] 

Image -encoding using the wavelet transform technique is 
featured by hierarchical structure according to resolution 
levels as shown in Fig. 16(b). This method can easily decode 
images having different resolution levels from a part of coded 
data or a whole coded data. 
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Namely, an image of a quarter (1/4) the original image size 
can be decoded by decoding subbands "4" . "D", "A" and An 
image of a half (1/2) the original image size can be decoded 
by decoded subbands "4", "0", "A" , "I", # -/\- an( j A 

complete (1/1) size image can be produced by decoding all 
subbands . 
[0015] 

Referring to Fig. 18, the operation of the horizontal 
low-pass (H-LP), horizontal high-pass (H-HP), vertical 
low-pass (V-LP) and vertical high-pass (V-HP) filters shown 
in Fig. 15 will be described as follows. Figure 18(b) is an 
enlarged view of an encircled part of Fig. 18(a) . When an output 
of a horizontal 9 tap filter, associated with a pixel 1801 
positioned right top on the original image is calculated for 
wavelet transformation of an original image, the operation of 
the filter must be performed on an area 1802. However, a part 
of the objective area 1802 is out of the boundary of the original 
image, where no data exists. The vertical filters may also 
encounter with a similar problem. Thus, for operation on the 
periphery of the image, it is often needed to use external data 
outside the image boundary according to the number of the taps 
of the filter used. Iteration of the subband decomposition also 
results in enlarging the area into which the filter extrudes. 
[0016] 

[Problems to be solved by the Invention] 

For the Flash Pix method using a plurality of coded data 
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sets separately provided for respective images of different 
resolution levels, the image processing load such as 
enlargement or contraction of the image can be reduced, but 
the data size is Increased to 1.4 times. For wavelet -transform 
coding method, data with different resolution levels can be 
easily decoded from a single set of ; compressed and coded data 
for an original image size and, therefore, no increase in the 
data size takes place. 
10017] 

When the wavelet- transform coding system utilizes the 
method of decomposing an image into tiles and encoding the image 
data on a tile-by-tile basis, which is used in the flash-pix 
system ( to reduce the processing load by selectively processing 
only necessary tiles in case of processing a particular part 
of the image) , however, this arises the above-described problem 
since filters may stick from the boundary of respective tiles. 
In other words, the flash pix system using the JPEG coding can 
easily perform coding of each tile owing to the closed property 
of coding in each tile, while the wavelet- transform coding 
system can not effectively use the above tile-by-tile 
coding-and-managing method because the processing causes the 
extrusion of filters out of respective tiles. 
[0018] 

In addition, the conventional wavelet- transform coding 
system must have a memory sufficient for storing an output of 
the wavelet-transform portion 1401 (Fig. 14), i.e., all wavelet 
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transform coefficients as shown in Fig. 16(b). Since these 
coefficients have the same resolution as that of the original 
image, the memory has to possess a large capacity. This 
requirement becomes severer when processing a higher 
resolution image. 
[0019] 

In view of the above -described problems of the prior arts, 
the present invention was made to provide a compact hardware 
system that realizes effective encoding of images with 
different resolutions and effective management of coded data 
by tiles by using an improved wavelet -transform technique. 
[0020] 

[Means for solving Problem] 

An object of the present invention according to claim 1 
is to provide an image coding device comprising: 

a tile decomposition portion for decomposing image data 
into tiles each having N pixels x M pixels; 

a wavelet coding portion for extrapolating a predetermined 
data at the periphery of the objective data from the tile 
decomposition portion, decomposing each of the tiles into 
subbands and separately wavelet -encoding each of the tiles; 

a management information generating portion for generating 
management information necessary for independently decoding 
coded data of the subbands from the wavelet coding portion on 
a tile-by-tile basis as well as on the subband-by-subband 
basis; and 
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a coded data integrating portion for combining the data 
separately wavelet -encoded on a tile-by-tile basis according 
to the management information outputted from the management 
information generating portion and attaching the management 
information to the coded data. 
[0021] 

Another object of the present invention according to the 
claim 2 is to provide an image decoding device for receiving 
Coded data coded and inputted by the image coding device of 
claim 1 and reproducing a desired image by selectively decoding 
the coded data of necessary tiles and subbands , comprising: 

a management information separating portion for separating 
tile-and-subband management information from input coded 
data; 

a coded data extracting portion for selectively extracting 
coded data of required decodable objective tiles and subbands 
according to the management information; 

a wavelet decoding portion for performing wavelet decoding 
of the extracted coded data in compliance with the wavelet 
coding conducted by the image coding device of claim 1; and 

a tile combining portion for combining wavelet -decoded 
tile images into a desirable image. 
[0022] 

Another object of the present invention according to the 
claim 3 is to provide an image coding device comprising: 

a tile decomposition portion for decomposing image data 
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into tiles each of N pixels x M pixels and outputting the N 
pixels x M pixels in the tile as an objective data to be coded 
for a corresponding each of the tiles ; 

a peripheral pixel adding portion for providing an 
objective tile to be coded with adjacent pixels necessary for 
wavelet transformation of the objective tile to be coded when 
such pixels exist at the periphery thereof; 

a wavelet coding portion for extrapolating a predetermined 
data when no pixel existing at the periphery of the objective 
tile to be coded, decomposing each of the tiles into subbands 
and outputting only wavelet coefficients of the objective tile 
to be coded; 

a management information generating portion for generating 
management information necessary for independently decoding 
coded data outputted from the wavelet coding portion on a 
tile-by-tile basis as well as on a subband-by-subband basis ; 
and 

a coded data integrating portion for combining the data 
separately wavelet -encoded on a tile-by- tile basis according 
to the management information outputted from the management 
information generating portion and attaching the management 
information to the coded data. 
[0023] 

Another object of the present invention according to the 
claim 4 is to provide an image coding device comprising: 

a wavelet coding portion for decomposing an image into 
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subbands by extrapolating a predetermined data at the periphery 
of the image, and performing wavelet encoding of the subbands; 

a tile composing portion for reconstructing, from wavelet 
coefficients inputted from the wavelet coding portion, 
separate tiles each being composed of N x M wavelet coefficients 
forming a (membership) set to be separately entropy coded; 

a management information generating portion for generating 
management information necessary for independently decoding 
coded data outputted from the wavelet coding portion on a 
tile-by-tile basis as well as on a subband-by-subband basis; 
and 

a coded data integrating portion for composing a sequence 
of the coded data according to the management information from 
the management information generating portion and attaching 
the management information to the coded data. 
[0024] 

Another object of the present invention according to the 
claim 5 is to provide an image decoding device for receiving 
coded data coded and inputted by the image coding device defined 
in any of claims 3 to 4 and reproducing a desired image by 
decoding the coded data of necessary tiles and subbands , 
comprising : 

a management information separating portion for separating 
tile-and subband management information from the input coded 
data; 

a coded data extracting portion for extracting coded data 
16 
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part corresponding to an objective tile and subbands according 
to the management information; 

a wavelet decoding portion for performing wavelet decoding 
of the extracted coded data by the image coding device and 
obtaining the decoded image composed of on the tile -by- tile 
basis ; and 

a tile integrating portion for arranging the wavelet - 
decoded image composed of on the tile-by-tile basis at 
respective places on an original image and superposing image 
values at overlaps of neighboring tables to integrate the tiles 
into a desired decoded image. 
[0025 ] 

Another object of the present invention according to the 
claim 6 is to provide an image decoding device for receiving 
coded data coded and inputted by the image coding device defined 
in any of claims 3 to 4 and reproducing a desired image by 
selectively decoding the coded data of necessary tiles and 
subbands , comprising : 

a management information separating portion for separating 
tile-and subband management information from input coded data; 

a coded data extracting portion for selectively extracting 
coded data of required decodable objective tiles and subbands 
according to the management information; 

a wavelet decoding portion for performing wavelet decoding 
of the extracted coded data by the image coding device , and 

a wavelet -coef f icient rearranging portion for rearranging 
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the wavelet coefficients reconstructed on a tile-by-tile basis 
by the wavelet decoding portion into an initial order of them 
before having been tiled. 
[0026] 

Another object of the present invention according to the 
claim 7 is to provide an image coding device as defined in any 
of claims 1 to 3 , wherein the wavelet coding portion is provided 
with a memory necessary for storing at least data for the tile. 
T0027] 

Another object of the present invention according to the 
claim 8 is to provide An image decoding device as defined in 
any of claims 2 to 5 , wherein the wavelet decoding portion 
includes a memory for storing data at least for the tile. 
[0028] 

[Modes for carrying out the Invention] 

Figure 1 is a block diagram showing the construction of 
an image coding device that is an embodiment 1 of the present 
invention. Image data of an original image as shown in Fig. 
2(a) is decomposed by a tile decomposition portion 101 into 
tiles each of predetermined N pixels by M pixels . The decomposed 
image is shown in Fig. 2(b). The tile decomposition portion 
101 outputs N pixels by M pixels image in a tile as corresponding 
data to each tile. 
[0029] 

Further processing will be described by way of example on 
a tile "i" in Fig. 2(b). Image data of the tile "i" is divided 
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by a wavelet transform portion 102 into subbands . Data at the 
periphery of a tile is extrapolated when dividing the tile 
portion near its boundary into subbands. For example, as shown 
in Fig. 18(b), an area 1802 covered by a wavelet transform 
filter exists out of a tile. In this case, it is needed to add 
data at the periphery of the tile. The wavelet transform portion 
102 therefore extrapolates data at the periphery of each tile 
and divides the tile into subbands. The data extrapolation is 
achieved for example by generating a mirror image by outwardly 
folding an internal image of the tile as shown in Fig. 2(c). 
A quantizing portion 103 quantizes wavelet transform 
coefficients and an entropy coding portion 104 performs entropy 
coding of the coefficients to obtain coded data of the tile 
"i" . The entropy coding can be achieved by using a known Huffman 
coding method or arithmetic coding method. The wavelet 
transform portion 102, quantizing portion 103 and entropy 
coding portion 104 composes a so-called wavelet- transform 
coding portion 105. 
[0030] 

On the other hand, a management information generating 
portion 106 generates information for identifying and managing 
tiles and subbands by using information on spatial locations 
of each tile from the tile decomposition portion 101 and 
information on each subband from the wavelet -transform coding 
portion 105. The management information is utilized by a coded 
data integration portion 107. 
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[0031] 

Using the management information from a management 
information generating portion 106, the coded data integration 
portion 107 arranges and integrates information on the coded 
data from the entropy coding portion 109 and adds the management 
information to a bit stream to generate coded data. Management 
of the coded data according the tiles and subbands is needed 
for achieving decoding of a coded image at different resolution 
levels as shown in Fig. 13(a) or a particular tile or tiles 
of the coded image. 
[0032] 

Figure 3 shows an example of a bit stream of coded data 
produced in the above -described manner. The bit stream is 
composed of a header for managing information on a whole bit 
stream and information on each tile . Information for each tile 
consists of a tile header for managing the tile information 
and coded information representing a tile image encoded by the 
wavelet transform coding portion. The tile header includes 
information on bit positions corresponding to respective 
subbands. A bit sequence corresponding to necessary one of the 
subbands can be found by accessing this information. The 
structure of bit streams used in the system of the present 
invention is not limited to that shown in Fig. 3. For instance, 
the tile header could include all the information of itself. 
Decoding of bit stream in Fig. 3 will be described later. 
[0033] 
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Then, the operation of an image decoding device is 
described by using Fig. 4. Figure 4 is a block diagram of an 
image decoding device according to the embodiment 2 
corresponding to the claim 2. The image decoding device 
receives coded data from the image coding device described as 
the embodiment 1 of the present invention. A management data 
separating portion 111 takes out information for managing tiles 
and subbands from the received coded data. A coded data 
extracting portion 402 selectively extracts coded data of 
necessary tile and subbands according to the user's request. 
In the exemplary bit stream shown in Fig. 3, the management 
information is found in the header and the tile header. 
[0034] 

The extracted coded information is entropy-decoded by an 
entropy decoding portion 403 and inversely quantized by an 
inverse quantizing portion 404 to produce wavelet -transform 
coefficients corresponding to the tile to be decoded. The 
wavelet -trans form coefficients are inversely transformed by 
an inverse wavelet transform portion 405 to produce a decoded 
image of the objective tile. The entropy-decoding portion 403, 
inverse quantizing portion 404 and inverse wavelet -transform 
portion 405 compose a so-called wavelet- transform decoding 
portion 406. A tile combining portion 407 combines together 
decoded tiles according to the tile managing information 401 
to generate a decoded image of the desired area or at a desired 
resolution . 
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[0035] 

The decoding process with the bit stream shown in Fig. 3 
is as follows. To decode a low-resolution entire image (all 
tiles), coded data (1-a, 2-a, i-a, .„) , which correspond to 
low-resolution subbands, are decoded in order in respective 
tile by the wavelet -transform decoding portion 406 according 
to the tile with referring to subband information included in 
each tile header. The low-resolution decoded tiles are then 
combined by the tile -combining portion 407, thereby a whole 
low-resolution image is reproduced. 
[0036] 

From the low-resolution decoded image, a particular tile 
"i" can also be reproduced in an enlarged scale with the highest 
resolution by decoding all the coded information of the i- 
th tile which correspond to the tile image "i". Namely, coded 
information i-b extracted and decoded together with already 
extracted coded information i-a to obtain the desired decoded 
image. It is, of-course, possible to reproduce a high- 
resolution decoded image of all areas by decoding all coded 
information (all tiles including all subbands) . Thus, the image 
decoding device can easily decode any resolution image and/or 
any tile (partial) image can be easily decoded according to 
the user's request. 
[0037] 

An image coding device according to another embodiment 3 
of the present invention will be described with reference to 
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Fig. 5 showing its construction. 

This image coding device differs from the image coding 
device (embodiment 1) of Fig. 1 by the fact that it does not 
unconditionally conduct extrapolation of data at the periphery 
of an objective tile and utilizes another tile adjacent to the 
tile if such exists. 
[0038] 

Like the embodiment 1 , this image coding device decomposes 
an original image into tiles as shown in Fig. 6(a) at its tile 
decomposition portion 501. The image coding device further 
processes a tile "i" of the image as follows: In a 
wavelet-transform coding portion 503, image data of the tile 
"i" is wavelet-transformed through a wavelet -transform filter. 
In this case, if the filter extrudes from the tile "i" into 
neighboring tiles and covers part of pixels contained in the 
neighbors, image data of those pixels in the neighbors are also 
wavelet-transformed together with the image data of the 
objective tile "i" by the filter. 

Referring to Fig. 6, the objective tile "i" of Fig. 6(a) 
is extended by adding necessary shaded parts of neighboring 
tiles "-f"_"f» as shown in Fig. 6(b) and then wavelet -transformed. 
An adjacent pixel adding portion 502 realizes the above process 
by recognizing neighboring tiles around the objective tile 
according to the tile decomposition information from tile 
decomposition potion 501 and by adding necessary pixels if the 
neighbors exist. 
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[0039] 

Then, the tile image data added necessary adjacent pixels 
by the above peripheral adding portion is decomposed into 
subbands through the wavelet transform portion 503. When the 
object tile to be coded is at the edge of the image, data is 
extrapolated to the part which couldn't be added the necessary 
peripheral pixels to and decomposed into subbands . This data 
extrapolation is achieved by generating a mirror image like 
the embodiment 1. A quantizing portion 504 quantizes the 
wavelet transform coefficients and an entropy coding portion 
505 performs entropy encoding of the quantized coefficients 
to obtain coded information of the objective tile "i". The 
wavelet transform portion 503, quantizing portion 504 and 
entropy- coding portion 125 composes a so-called wavelet 
transform coding portion 506. 
[0040] 

On the other hands, a management information generating 
portion 507 receives spatial-tile-position information from 
the tile decomposition portion 501 and subband information from 
the wavelet transform coding portion 506 and generates 
management information for managing and identifying tiles and 
subbands. The management information is used by a coded-data 
integrating portion 508. 
[0041] 

The coded data integrating portion 508 rearranges and 
integrates coded information outputted from the entropy coding 
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portion 505 according to the management information outputted 
from the management portion 507 and then adds the management 
information to a bit stream to generate a final coded data (for 
example in Fig. 3). 
[0042 ] 

Another image coding device is described as an embodiment 
4 of the present invention. Figure 7 is a block diagram of an 
image coding device according to the embodiment 4 . 

This image coding device differs from the embodiment 1 of 
Fig. 1 and the embodiment 3 of fig. 5 by the fact that an original 
image is entirely wavelet- transformed by a wavelet transform 
portion 701 and, then, wavelet transform coefficients 
outputted from the wavelet transform portion 701 are rearranged 
per tile to compose respective tiles. 
[0043] 

An original image before tiling is wavelet- transformed by 
a wavelet transform portion 701. A tile composing portion 702 
composes tiles by rearranging wavelet transform coefficients 
so that a tile is composed of coefficients spatially matching 
the same tile. Figure 8(a) shows an example of subbands obtained 
by wavelet transform portion 701. In the shown case, a 
coefficient bO in the lowest frequency subband spatially 
correlates with other subband coefficients bl, b2 , b3 , b4, b5 , 
b6, b7, b8 and b9. Where bl-b3 consist each of lxl coefficient, 
b4-b6 consists each of 2x2 coefficients and b7-b9 consist each 
of 4x4 coefficients. These coefficients b0-b9 are taken out 
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of the respective subbands and then arranged to compose a single 
tile as shown in Fig. 8(b). Likewise, all other wavelet 
transform coefficients are arranged to compose respective 
tiles . This results in obtaining the same result as in the 
embodiment 5 whereby an original image is first decomposed into 
portion tiles and then wavelet transformed. bO is not 
necessarily a single coefficient , but it may be a block composed 
of k x 1 coefficient. In this case, bl-b3 consist each of k 
x 1, b4-b6 consist each of 2k x 21 and b7-b9 consist each of 
4k x 41 coefficients. , 
[0044 ] 

Wavelet transform coefficients organized per tile are 
outputted from the wavelet transform portion 702. They are 
quantized by a quantizing portion 703 and entropy- encoded by 
an entropy -coding portion 704, thus coded information is 
generated. 
[0045] 

On the other hand, a management -information generating 
portion 706 generates management information necessary for 
managing and identifying tiles and subbands using spatial- 
tile-location information from the tile composing portion 702 
and subband-location information from the wavelet transform 
coding portion 705. The management information is used by a 
coded-inf ormat ion integrating portion 707. 
[0046] 

The coded information integrating portion 707 receives the 
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management information from the management information 
generating portion 706 and the coded information from the 
entropy-coding portion 704 and it arranges and combines the 
entropy coded information and adds management information in 
a bit stream of the coded data, thus generating finally coded 
data (in Fig. 3). Although the tile-composing portion 702 is 
installed before the quantizing portion 703 in this embodiment , 
it is not limited to this arrangement and may be placed after 
the quantizing portion 703 . 
[0047] 

An image decoding device for decoding data encoded by any 
one of the above -de scribed image coding devices (embodiment 
3 or 4) is now described below. Figure 9 is a block diagram 
showing the construction of the image decoding device according 
to the embodiment 5 . The decoding device receives coded data 
encoded by any one of the image coding devices described above 
as embodiments 3 or 4 . The image decoding device separately 
takes out tile-decomposition management information and 
subband-management information from the input coded-data 
stream by a management information separating portion 901 and 
selectively extracts a necessary part of the coded information 
meeting the user's demand by a coded data extracting portion 
902 according to the management information. Namely, the coded 
data corresponding to a necessary objective tile(s) having a 
necessary resolution is extracted by the coded data extracting 
portion 902. 

27 

Copied from 10312014 on 09/14/2004 


[0048] 

The extracted coded information is entropy-decoded by an 
entropy decoding portion 903 and inversely quantized by an 
inverse quantizing portion 904 Thus, wavelet transform 
coefficients corresponding to an objective tile to be decoded 
are now obtained. The wavelet transform coefficients inversely 
transformed by an inverse wavelet transform portion 905, 
thereby a decoded image including peripheral pixels data is 
produced. The entropy coding portion 903, the inverse 
quantizing portion 904 and the inverse wavelet transform 
portion 905 compose a so-called inverse wavelet transform 
decoding portion 906. 
[0049] 

A tile combining portion 907 integrates groups of the 
decoded tiles according to the management information from the 
management information-separating portion 901. In this case, 
a completely decoded image is reproduced with overlaps of 
decoded tile images at each spatially overlapped portion. 
[0050] 

Namely, the embodiment 3 uses peripheral pixels in 
performing wavelet transform of each tile as shown in Fig . 6(b). 
In the image coding device according to the embodiment 4 , the 
process using peripheral pixels is not clearly described but 
the wavelet transform of a whole original image has been done 
including the processing theoretically equivalent to that. 
Therefore, the decoded peripheral pixels are superposed on 
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respective neighboring tiles by the tile combining portion 907 . 
The superposition of one pixel on another is achieved by 
additive operation on the pixels . 
[0051] 

Another image decoding device is described below as an 
embodiment 6 of the present invention. Like the above 
embodiment 5 , the input to this embodiment 9 is coded data 
encoded by any one of the image coding devices being the 
embodiments 3 or 4 . Figure 10 is a block diagram showing the 
construction of the image coding device according to the 
embodiment 9. A management information separating portion 1001 
separately takes out tile-division management information and 
subband management information from the input coded- data 
stream, and a coded data extracting portion 1002 selectively 
extracts a necessary part of the coded information meeting the 
user' s demand according to the management information. Namely, 
the coded data corresponding to a necessary objective tile(s) 
having a necessary resolution is extracted by the coded data 
extracted portion 1002. 
[0052] 

The extracted coded information is entropy-decoded for 
each tile by an entropy-decoding portion 1003 and inversely 
quantized by an inverse quantizing portion 1004. Wavelet 
transform coefficients corresponding to an objective tile to 
be decoded are thus obtained. A wavelet transform coefficient 
rearranging portion 1005 rearranges the wavelet transform 
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coefficients into the state in which they were placed before 
tile-by- tile arrangement. Namely, the wavelet transform 
coefficients divided per tile as shown in Fig. 8(b) are 
rearranged in the state shown in Fig. 8(a). After completion 
of processing on all tiles, all wavelet transform coefficients 
of Fig. 8(a) are obtained. The rearranged wavelet 
transform-coefficients can be decoded at a time by inverse 
transformation. Namely, the coefficients are inversely 
transformed by an inverse wavelet transform portion 1006, 
thereby a whole decoded image is reproduced. The entropy coding 
portion 1003, the inverse quantizing portion 1004 and the 
inverse wavelet transform portion 100 6 compose a so-called 
inverse wavelet transform decoding portion 1007. Although the 
wavelet transform coefficient rearranging portion 1005 is 
installed after the inverse quantizing portion 1004 in this 
embodiment, it is not limited to this arrangement and may be 
placed before the inverse quantizing portion 1004. 
[0053] 

An image coding device is described below as an embodiment 
7 of the present invention. 
[0054] 

Figure 11(e) is a block diagram of a portion of this 
embodiment, which responds to the wavelet transform portion 
(102 in Fig. 1, 503 in Fig. 5) of the image coding devices 
according to the embodiments 1 or 3 . Referring to Fig. 11(e), 
a memory 1102 is used for storing wavelet transform 
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coefficients divided into subbands by a wavelet transform 
portion 1101. In this case, the memory 1102 stores only wavelet 
transform coefficients corresponding to a tile being currently 
processed by the wavelet transform portion 1101 . The processed 
data are transferred to a quantizing portion (103 in Fig. 1, 
504 in Fig. 5) following the wavelet transform portion 1101. 
Therefore, the memory 1102 has no need to store all data for 
a whole image and is sufficient to store such an amount of data 
necessary for processing only one tile. Namely, if 
wavelet -transformation without tile decomposition is applied 
to a whole image as shown in Fig. 11(a), it is necessary to 
store all wavelet transform coefficients (Fig. 11(b)) 
outputted from the wavelet transform portion 1101 . In contrast 
to the above, the decomposition of an image into tiles as shown 
in Fig. 11(c) enables the coding device to use a memory for 
storing only wavelet transform coefficients corresponding to 
a small image of Fig. 11(d), thus realizing a considerable 
saving of the memory capacity. 
[0055] 

The same effect can be realized in an image decoding device. 
An image decoding device is described below. Figure 12 is a 
block diagram, which corresponds to the inverse wavelet 
transform portion (405 in Fig. 4, 905 in Fig. 9) of the image 
decoding devices described before as the embodiments 2 or 5 . 
[0056 ] 

Referring to Fig. 12(e), a memory 1201 stores wavelet 
31 

Copied from 10312014 on 09/14/2004 


transform coefficients necessary for decoding one tile and an 
inverse wavelet transform portion 1202 performs the 
composition of subbands . An image that must be decoded is 
assumed to be that shown in Fig. 12(b) When performing the 
wavelet transform of the image without decomposition into tiles , 
it is necessary to store all wavelet transform coefficients 
as shown in Fig. 12(a) . On the contrary, when decoding an image 
decomposed into tiles as shown in Fig. 12(d) , the image decoding 
device can operate using a memory 1201 storing the limited 
number of wavelet transform coefficients as shown in Fig. 12(c) . 
The necessary memory capacity can be considerably saved. 
[0057] 

[Effect of the Invention] 

Accordingly, an object of the present invention is to 
provide an image coding and decoding system by which the image 
is effectively encoded and easily decoded with any resolution 
level desired by the user with no increase in volume of coded 
data. 
[0058] 

This is a great advantage of the present invention system 
as compared with the conventional Flash Pix system using the 
JPEG coding method, which has an increased amount to 1 . 4 times 
of code data to provide a plurality of images having different 
resolutions . 

Another object of the present invention is to provide an 
image-coding and decoding system in which an image is 
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decomposed into tiles and encoded on a tile-by-tile basis and 
the coded tiles can selectively decoded on the same principle 
by using the wavelet -transform coding/decoding technique. 
This could not be accomplished by the conventional 
wavelet -transform coding/decoding system because it is 
difficult in principle to apply the wavelet transform to closed 
tiles of the image . 

Another object of the present invention is to provide an 
image coding and decoding system that encodes an image on a 
tile-by- tile basis and allows the coded image to be partially 
decoded by selectively decoding only necessary tiles (without 
the necessity of decoding a whole image), thus improving the 
random access function of the system. 
[0059] 

As described herein, following aspects are brought 
according to the present invention. 

In one aspect of the present invention, an image coding 
device according to the claim 1 can independently encode each 
of tiles of an original image, thus providing coded tile images 
that can be separately treated thereafter. If any of coded tile 
must be further processed, it can be separately, processed and 
encoded again with no need of using adjacent pixels. Thus, 
simple independent encoding and decoding of image tiles is 
realized. 
[0060] 

In another aspect of the present invention, an image 
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decoding device according to the claim 2 can decode only a 
desirable coded tile image with no need of decoding any other 
coded data, thereby minimizing the processing load. 

In another aspect of the present invention, in spite of 
increasing of the coded-data size due to encoding an objective 
tile image including adjacent pixels an image decoding device 
decodes the coded tile image by superposing adjacent pixel 
values on overlaps, suppressing possible boundary distortion 
of the tile image . 
[0061] 

In still another aspect of the present invention, an image 
coding device according to the claims 3 and 4 and an image 
decoding device according to the claims 5 and 6 can encode tile 
images using pixel information on neighboring tiles, achieving 
high efficiency of image encoding using the correlation between 
tiles. This can also suppress possible boundary distortion of 
the tile images. 
[0062] 

In another aspect of the present invention, an image coding 
device according to the claim 3 can effectively encode a part 
(plural tiles ) of a whole image by performing wavelet transform 
of only selected tiles, and its wavelet transform is very 
compact . An image decoding device responding to the above can 
also realize compact inverse wavelet transform of coded tile 
images . 
[0063] 
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A whole image is wavelet transformed at a time and then 
wavelet transformed coefficients are rearranged to compose 
respective tiles. This eliminates the need of iterating the 
wavelet-transform for each tile (claim 4). In another aspect 
of the present invention, an image decoding device according 
to the claim 6 can rearrange coded data (decomposed for each 
tile) corresponding to an objective tile and then perform 
inverse wavelet transform of the coded data at a time, thus 
eliminating the need of repeating inverse wavelet transform 
for each tile. 
[0064] 

Conventional arts demand a large capacity of a memory for 
holding wavelet transform coefficients to correspond to 
resolution of an original image. In contrast to the above, an 
image coding device according to one aspect of the present 
invention (claim 7) can use, irrespective of the original image 
size, a memory which can store only wavelet transform 
coefficients for capacity corresponds to the size of a tile 
or tiles for a tile or tiles being currently encoded. This can 
realize a considerable saving of memory capacity needed. In 
another aspect of the present invention, an image decoding 
device according to the claim 8 can also use a memory having 
the capacity limited to a tile size for storing wavelet 
transform coefficients. 
[Brief Description of the Drawings] 

Figure 1 is a block diagram of an image coding device 
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according to an embodiment 1 of the present invention. 

Figure 2 is a view for explaining the operation of an image 
coding device according to the embodiment 1 of the present 
invention . 

Figure 3 shows an exemplified bit stream of the present 
invention . 

Figure 4 is a block diagram of an image decoding device 
according to an embodiment 2 of the present invention. 

Figure 5 is a block diagram of an image coding device 
according to an embodiment 3 of the present invention. 

Figure 6 is a view for explaining the operation of an image 
coding device that is an embodiment 3 of the present invention. 

Figure 7 is a block diagram of an image coding device 
according to an embodiment 4 of the present invention. 

Figure 8 is a view for explaining the operation of an image 
coding device according to the embodiment 4 of the present 
invention . 

Figure 9 is a block diagram of an image decoding device 
according to an embodiment 5 of the present invention. 

Figure 10 is a block diagram of an image decoding device 
according to an embodiment 6 of the present invention. 

Figure 11 is a block diagram of an image coding device 
according to an embodiment 10 of the present invention, with 
a view for explaining the operation of the same device. 

Figure 12 is a block diagram of an image decoding device 
according to an embodiment 8 of the present invention, with 
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a view for explaining the operation of the same device. 

Figure 13 is a block diagram of a prior art, with a view 
for explaining the operation of the same device. 

Figure 14 is a block diagram of a prior art. 

Figure 15 is a block diagram of a prior art. 

Figure 16 is a view for explaining a prior art. 

Figure 17 is a block diagram of a prior art. 

Figure 18 is a view for explaining a prior art. 
[Explanations of Letters and Numerals] 

101- Tile Decomposition Portion 

102- Wavelet Transform Portion 

103- Quantizing portion 

104- Entropy Coding Portion 

105- Wavelet Coding Portion 

106- Management Information Generating Portion 

107- Coded Data Integrating Portion 

401- Management Information Separating Portion 

402- Coded Data Extracting Portion 

403- Entropy Decoding Portion 

404- Inverse Quantizing Portion 

405- Inverse Wavelet Transform Portion 

406- Wavelet Decoding Portion 

407- Tile Combining Portion 

501- Tile Decomposition Portion 

502- Adjacent Pixel Adding Portion 

503- Wavelet Transform Portion 
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504- Quantizing portion 

505- Entropy Coding Portion 

506- Wavelet Coding Portion 

507- Management Information Generating Portion 

508- Coded Data Integrating Portion 

701- Wavelet Transform Portion 

702- Tile Composing Portion 

703- Quantizing portion 

704- Entropy Coding Portion 

705- Wavelet Coding Portion 

706- Management Information Generating Portion 

707- Coded Data Integrating Portion 

901- Management Information Separating Portion 

902- Coded Data Extracting Portion 

903- Entropy Decoding Portion 

904- Inverse Quantizing Portion 

905- Inverse Wavelet Transform Portion 

906- Wavelet Decoding Portion 

907- Tile Integrating Portion 

1001- Management Information Separating Portion 

1002- Coded Data Extracting Portion 

1003- Entropy Decoding Portion 

1004- Inverse Quantizing Portion 

1005- Wavelet Coefficient Rearranging Portion 

1006- Inverse Wavelet Transform Portion 

1007- Wavelet Decoding Portion 
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1101- Wavelet Transform Portion 

1102- Memory 

1201- Memory 

1202- Inverse Wavelet Transform Portion 

1301, 1305, 1309, 1313- Tile Decomposition Portion 
1304, 1308, 1312- 1/2 Contraction Portion 

1302, 1306, 1310, 1314- JPEG Compressing Portion 

1303, 1307. 1311, 1315- Coded Data Integrating Portion 

1401- Wavelet Transform Portion 

1402- Quantizing Portion 

1403- Entropy Coding Portion 

1404- Wavelet Coding Portion 

1501, 1514, 1526- Horizontal Low-Pass Filter 

1502, 1515. 1527- Horizontal High-Pass Filter 

1503, 1505. 1516. 1518, 1528, 1530- Vertical Low-pass Filter 

1504, 1506, 1517, 1519, 1529, 1531- Vertical High-pass Filter 
1507 to 1512, 1520 to 1525, 1532 to 1537- 1/2 Sampling Portion 
1513- Low-horizontal and Low-vertical Frequency Subband 

1701- Entropy Decoding Portion 

1702- Inverse Quantizing Portion 

1703- Inverse Wavelet Transform Portion 

1704- Wavelet Decoding Portion 

1801- Pixel to which a Filter is Applied 
18 02- Area to be covered by a Filter 
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FIG.16 
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[Abstract] 
[Object] 

An image encoder/decoder by which a partial image is 
encoded easily with a resolution meeting the user's demand, 
the encoded amount of data is not increased and a necessary 
capacity of memory can be reduced. 
[Solving Means] 

The image encoder has a tile decomposition portion which 
divides image data into tiles of N pixels x M pixels , a wavelet 
transform coding portion which extrapolates predetermined 
data at the peripheries of the tiles outputted from the tile 
decomposition portion and performs subdivision to perform 
wavelet encoding, a management information generating portion 
which generates information for managing the encoded data in 
order that the encoded data outputted from the wavelet 
transform coding portion can be decoded for each tile and for 
each subband of the wavelet encoding, and an coded data 
integration portion which links the encoded data encoded by 
wavelet encoding for each tile by using the output of the 
management information generating portion and adds the 
managing information to the encoded data. 
[Selected Drawing] Fig. 1 
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